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1.0  Introduction.  In  this  paper  we  are  concerned  with  several  random  pro- 
cesses that  occur  within  the  class  of  M/C/1  queues  with  instantaneous  feed- 
back in  which  the  feedback  decision  process  is  a Bernoulli  process.  Such 
systems  in  the  case  G=M  are  the  simplest,  non-trivial  examples  of  Jackson 
networks  [-5].  Indeed,  they  are  so  simple  that  they  are  usually  dismissed 
from  consideration  in  queueing  network  theory  as  being  obvious.  We  will  show 
that  far  from  being  obvious  they  exhibit  some  important,  unexpected  properties 
whose  implications  raise  some  interesting  questions  about  Jackson  networks 
and  their  application. 

In  particular,  Jackson  [5]  observed  that  in  his  networks  the  vector 
valued  queue  length  process  behaved  as  if  the  component  processes  were  in- 
dependent, M/M/1  systems.  Since  those  results  appeared  there  lias  developed 
a mythology  to  explain  them.  These  arguments  usually  rest  on  three  sets  of 
results  that  are  well  known  in  random  point  process  theory:  superposition, 

thinning,  and  stretching.  By  examining  the  network  flow,  it  will  be  shown 
that  the  application  of  these  results  are  inappropriate  to  queueing  network 
with  instantaneous,  Bernoulli  feedback.  Their  flows  are  considerably  more 


complicated  than  one  expects  based  on  such  arguments  and  one  is  left  to 
ponder  what  the  Jackson  results  me. in  to  queueing  network  decomposition.  »- 

I • I I he  Problem  and  Notation.  We  assume  the  usual  apparatus  of  M/G/l  queues 
with  unlimited  waiting  capacity.  The  new  idea  is  that  a unit  which  has  received 
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service  departs  with  probability  q and  returns  for  more  service  with  probabil- 
ity p.  p+q=l.  Without  loss  of  generality  for  the  processes  studied  here  the 
returning  customer  can  be  put  anywhere  in  the  queue. 

To  establish  notation  it  is  assumed  that  the  arrival  process  is  a 
Poisson  process  with  parameter  A>0.  The  arrival  epochs  are  the  elements  of 


f T ; n-1,2,...}.  Service  times  are  i.i.d.  random  variables,  S with 
n n 


Pr[S  < t]  = H ( t ) , t > 0, 
n 


E [ S ] < 
n 


The  arrival  process  and  service  times  are  independent  processes. 


Service  completions  occur  at  Tq<T^<T9...  called  the  output  epochs.  Let 


Yn  YT 


(0,  i 

U,  i 


if  the  n-th  output  departs 
if  the  n-th  output  feeds  back. 


{ } is  a Bernoulli  process. 

Elements  of  the  subset  {t^JCfT  are  called  the  departure  epochs  and  are 

the  times  at  which  an  output  leaves  the  system.  The  elements  of  the  subset 

1 are  called  the  feedback  epochs  and  are  the  times  at  which  an  output 

returns  to  the  queue.  It  }(J{t  } = IT  }. 

n n n 

The  times  T'  are  the  times  at  which  a unit  enters  the  queue.  IT'}  is 
n n 

railed  the  input  process.  { T ' } = {T  }U(  t }• 

— J i n n n 

There  are  six  queue  length  processes  to  be  studied.  They  are  closely 


- 

. 


-3- 

tively  the  embedded  queue  lengths  at  arrival  epochs,  input  epochs,  output 
epochs,  departure  epochs. 

2.0  Queue  Length  Processes . The  queue  lengths  listed  in  1.1  are  closely 
related.  The  steady  state  versions  of  'Q^(n)}  and  {Q^(n)}  are  of  primary 
concern.  They  are  studied  in  sections  2.1  and  2.2  separately.  They 
are  related  to  the  other  processes  in  section  2.3.  The  important  special 
case  for  G=M  is  then  studied  in  2.4. 


2.1  The  {Q, (n)  } Process . There  are  several  ways  to  study  this  process. 

The  following  appears  to  be  direct,  correct  and  may  help  explain  why  these 
feedback  problems  have  received  such  little  attention  in  the  queueing  litera- 
ture. First  it  is  clear  that 


t 

n 


t + S’ , if  qt(n-l)>0, 
n-1  n 4 


t , + I 
n-1  n 


+ s;’ 


if  Q4(n-1)=0. 


Here  S'  is  the  total  service  time  consumed  between  the  (n-l)-st  and  n-th 
n 

departure.  I is  the  idle  time  following  t ,.  For  the  M/G/l  queues  i! 

' n n-1  n 

are  i.i.d.  random  variables  Lhat  are  exponentially  distributed  with  parameter 
X . 

Without  loss  of  generality,  since  customers  are  indist inguisable , 


S'  = S,  + S + ...  S , for  everv  n. 
n 1 m 


in  is  the  number  of  services  performed  between  the  n-th  and  (n-l)-st  departure. 


Since  IY  > is  a Bernoulli  process,  m is  geometrically  distributed  anti  it 
n 

follows  that  {S' } is  a sequence  of  i.i.d.  random  variables.  Thus  the  laplart 
n 

transform  of  the  distribution  function  of  S'  is  oasilv  found  to  be 

n 


■mpmiRH 


■I 


G*  (s)  = qH*(s)/[l-pH*(s) ] 


Using  standard  embedded  Markov  chain  methods  one  finds  that  the  pro- 
bability generating  function  of  IT'  the  limiting  probability  distributions 


of  { Q^(n)},  is  given  by 


(2.1.1) 


g'(z) 


r (0)  (_z- 1 ) G* ( A-A  z ) 
z-G*(A-Az) 


and 


(2.1.2)  n' (0)  = 1 - AE [ S ]/q. 

n 

Since  (2.1.1)  and  (2.1.2)  are  of  the  form  one  finds  for  M/G/l  queues 
without  feedback,  by  properly  adjusting  the  mean  service  time,  it  can  be 
argued  that  the  queue  length  process  embedded  at  departure  points  for  queues 
with  and  without  feedback  are  asymptotically  identically  distributed.  In 
fact,  this  result  is  true  for  all  n. 

2.2.  The  (Q+(n)}  Process.  This  is  the  queue  length  process  embedded  at 

output  points.  Since  {t  }CfT  ( U)T(n)}  is  a process  on  a courser  grid  than 

n n 4 

fQ^(n)i.  Since  one  is  ultimately  to  be  concerned  with  both  i'Q^(n))  and 

f T -T  ,},  the  following  study  is  for  the  joint  process  fo.(n),  T -T  . t. 
n n-1  J 3 n n-1 

The  marginal  results  for  { Q ^ (n) } then  will  be  easy  to  determine. 

Theorem  2.2.1.  The  process  1 ()"*”( n)  ,T  -T  ,1  is  a Markov  Renewal  process 

i n n-1 

with  transition  functions  A(  i , j , x)  = l’r  (<)+(n)=  j , T^-I  _ ^ ux  j (n- 1 ) = I | where 


m 


A(i,j,x)  = 


qe  dH(y)  , i^O , j = i-l , 


0 

X 


0'xy  [p  + dH(y),  i^O,  j - 1, 


Jo  6 


(j-i+1) 


/X  [l-e-X(x-y>|  ^ e"A>'  [p  + dH(y)  , 1=0,  j 


0, 


/o  [1"e 


-Hx-y)]  e-Xy  qdH(y)>  i = j = 0. 


Proof  . 


S , if  Q„ (n-1)  > 0 
n j 


T -T  , 
n n-1 


+ , 


I +S  , if  Q. (n-1)  = 0 
n n 3 


where  I is  the  exponentially  distributed  idle  time  preceeding  S if  Q^(n  1)  0. 
n 11 


The  result  then  follows  directly  using  arguments  as  in  |4|. 

If  x k*'  , A ( i , j ,x)  ■*  A(  i , j ) the  one  step  transition  probability  for  the 


(O^(n)}  process.  Then  using  standard  embedded  Markov  chain  results  one  can 


show  that  the  probability  generating  function  g(z)  for  the  limiting  probabil itie. 
II  ( j ) are  given  by 


g(z)  = 


Id)  ( /-I  ) [ pzH*(  >.-/ y.)+qH*(X-X«.)  I 


z-pzH* ( A-Xz)-qll* ( X-Az) 


and 

11(0)  = q - IE  IS  I . 

n 

2.)  other  Queue  Length  Processes.  The  queue  length,  limiting  probabilities 
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for  the  three  queueing  processes  { ( t ) } . {Q  (n)},  {(^(n)}  now  follow  from  a 
theorem  found  in  Cooper  [3].  From  this  it  follows  that  { ( t ) } ; {Q^(n)J; 
(Q+(n)}  are  asymptotically  identically  distributed  and  {(^(n)};  {Q+(n)}  are 
asymptotically  identically  distributed.  Clearly,  (Q+(n)}  and  (Q^Cn)}  are  not 
asymptotically,  identically  distributed. 

The  difference  can  be  explained  as  follows.  Any  output  must  be  either 
a feedback  or  a departure,  if  the  queue  length  is  j after  an  output  then 
either  there  has  been  a feedback  and  the  queue  length  is  now  j , or  there  lias 
been  a departure  and  the  queue  length  is  now  j . 

Thus  II  (j  )=qi1 ' (j  )+  p (Pr  (queue  length  after  a feedback  is  j)).  Since  a 
queue  length  of  j after  a feedback,  and  a queue  length  of  j-1  after  a depar- 
ture, both  correspond  to  a queue  length  of  j before  the  output,  and  so  have 
the  same  probability 


n(j)  = qJi'(j)  + pn'(j-i)  j > l, 
n(0)  = qn'(0). 

From  the  above  argument  and  Cooper's  theorem  it  can  be  seen  that  the  pro- 
bability of  j in  the  queue  just  after  an  input  (i.e.,  either  a feedback  or 
and  arrival),  is  given  by  11'  (j-1). 

For  the  M/M/1  feedback  queue,  where 

H * (j-1)  - (1  - -)(  -- )M  . j = 1.2 

pq  pq 

this  result  was  pointed  out  in  Burke  [2]. 

2.4  The  M/M/1  Case.  If  one  assumes  that  the  service  time  distribution  is 

-pt 


H ( t ) = 1 - e 


, t > 0 , 
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some  further  classification  is  possible  here.  From  the  results  of  Jackson 


"’0>  ■ (1-  • i * °-1’2- 


From  (2.1.1)  and  (2.1.2)  one  obtains 


n(°)  ■ on  ' • 


"«>  ■ <»  + ir)-  j - n2’--- 


3.0  Flow  Processes.  To  further  clarify  the  problems  here,  it  is  useful 
to  study  the  flow  processes  in  this  system.  There  are  five  processes  of 
interest:  the  arrival  process;  the  input  process;  the  output  process;  the 

departure  process;  and  the  feedback  process. 

There  has  been  some  questions  since  the  publication  of  the  Jackson 
results  concerning  the  interpretation  of  his  results  [1],  [2],  In  his  paper 
Jackson  showed  that  for  his  networks  the  joinc  limiting  probability  for  the 
vector  or  queue  lengths  at  each  server  could  be  factored  into  limiting  pro- 
babilities for  the  queue  length  at  each  server.  This  implies  that  the  queue 
lengths  are  independent  in  the  limit.  The  remarkable  result  was  that  the 
marginal  limiting  probabilities  were  precisely  those  of  an  M/M/1  queue. 

Burke  [2],  has  argued  that  the  Jackson  results  are  surprising.  Burke's 
argument  is  based  on  showing  that  the  input  to  a single  server  queue  with 

feedback  is  not  Poisson  because  the  interinput  times  (our  IT'})  are  not  ex- 

n 

ponentially  distributed.  (2J  gives  the  precise  result 


Pr[T'  < xj  - 1 - ^ e"At  - EH.e—  , t * 0. 
n ~ p-A  p— A 
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In  this  section  we  will  study  some  of  the  flows  in  this  network  and  show 
indeed  the  Jackson  results  are  surprising.  A conjecture  based  on  these  results 
will  be  given  in  section  4. 

3.1  Departures.  The  departure  process  {t  } can  be  studied  as  in  Disney, 
n 

Farrell,  deMorais  [4]  upon  using  the  mapping  in  section  2.1.  Thus  we  know 
that  this  departure  process  is  a renewal  process  and  is  a Poisson  process  when- 
ever {S^}  is  a renewal  process  with  exponential  distribution.  This  is  the 
Jackson  case.  So  we  conclude  that  the  departure  process  from  the  Jackson 
network  is  a Poisson  process. 

From  the  results  of  section  2.1  there  is  a possibility  that  the 

departure  process  is  Poisson  even  if  is  not  exponentially  distributed. 

The  result  that  is  needed  for  the  results  of  [4]  to  follow  is  that  S'  be 

n 

exponentially  distributed  (since  it  is  known  that  {S'}  is  a sequence  mutually 

n 

independent,  identically  distributed  random  variables). 


Theorem  3.1.1.  If  H(t)  has  a Laplace  transform  then  the  departure  process 
from  the  M/G/l  queue  with  feedback  is  a Poisson  process  if  and  only  if  S^ 
is  exponentially  distributed  for  every  n. 


Proof . From  section  2.1  we  have  G*(s),  the  Laplace  transform  of  the 
distribution  function  H(t)  is  given  by 


G*(s) 


qH*(a) 
1-pH* (s) 


Thus  if  G*(s)  = - , S^  is  exponentially  distributed  with  a parameter  a 

and  the  departure  process  will  he  a Poisson  process  from  (4).  Thus,  if 


_a 

a+s 


qH*(s) 

1 -pH* ( s ) 
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is  exponentially  distributed.  But  the  only  solution  here  is 

H*(s)  = 

a/q+s 

which  implies  H(t)  is  exponential. 

3.2  Outputs  and  Inputs.  From  section  2.2  it  is  clear  that  the  output 
process  is  a Markov  Renewal  process  whose  distributions  are  given  by  A(i,j,x). 
From  these,  the  following  results  are  obtained. 

Theorem  3.2.1.  The  output  process  (T  -T  ,}  is  a renewal  process  if  and  only 

n n-1 

if  q = 1 and  H(t)  = 1 - e *jt. 

Proof . If  q=l  and  H(t)  = 1-e  1 , the  result  follows  from  [4],  Those  arguments  can  be 
modified  in  a trivial  way  to  show  that  equations  (3.1)  and  (3.2)  of  that  paper 
are  not  satisfied  jointly  for  any  q/1 . Thus  the  output  process  is  not  renewal. 

To  be  more  specific,  theorem  3.2.1  can  be  particularized  as 

Corollary  3.2.2.  The  output  process  {T  -T  , } for  the  M/M/1  queue  is  a 
Poisson  process  if  and  only  if  q=l . 

Proof.  Define 


F(x)  = P r [ T -T  < x]. 
n n- 1 

i ( x ) = All  where  U is  the  column  vectors  all  of  whose  elements  are  1,  is 
the  vector  of  limiting  probabilities  given  in  section  2.1  lor  fQ  (n)l  and  A 
is  the  matrix  of  A(i,j).  Then  from  theorem  2.2.1  one  obtains  after  some 
easy  manipulations: 

F(x)  = (q  - X)  / f 1-e  '<X  y*)  dll(v)  + (p+  ) H(x) 

d Q U 


(3.2.1) 


(3.2.2)  F(x)  = 1 - ^ e~Xx--^  e’UX,  x > 0. 

p-A  p-A 

Thus  single  intervals  are  not  exponentially  distributed  and  the  output  process 
is  not  a Poisson  process  unless  q=l  . 

Formula  3.2.2  was  previously  found  by  Burke  [2]  for  the  distribution  of 
times  between  inputs.  Whether  this  implies  that  the  output  random  process 
and  input  random  process  are  equivalent  processes  or  not  is  not  known.  One 
conjectures  that  they  are.  The  distribution  form  from  (3.2.2)  does  yield 

Corollary  3.2.3.  The  input  process  to  the  M/M/1  queue  is  not  a renewal 
process  unless  q=l. 

Proof . Assume  that  this  input  process  is  a renewal  process  with  intervals 
distributed  as  in  formula  (3.2.2).  From  Cooper  [3],  the  queue  length  process 
( Q 2 ( 11 ) ^ and  (Q+(n)}  should  then  be  identically,  asymptotically  distributed  as 
given  in  section  2.3.  Using  standard  methods  of  studying  Gl/M/1  queues  one 
finds  that  the  unique  root  to  the  standard  secular  equation,  which  lies  in 
(0,1)  is  given  by 

2 2 1/2 

a = [ (2p+A)  - [ (2p-A)  - 4pu  | ]/2p. 

It  then  follows  that  (Qj(n)J  and  (Q.,(n)}  are  asymptotically  identically  dis- 
tributed it  and  only  if  q= 1 (or  p=0)  . Thus  the  input  process  is  not  a renewal 
p rocess . 

It  seems  obvious  that  the  arrival  process  and  feedback  process  are  not 


Independent  processes.  One  can  show : 
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Corollary  3.2.4.  Either  the  feedback  process  is  not  a Poisson  process  or 
the  arrival  process  and  feedback  process  are  not  independent  processes. 


Proof.  This  result  follows  immediately  from  Burke's  result  on  the  distri- 
bution of  the  inter input  intervals.  For  if  the  feedback  process  is  both 
independent  of  the  arrival  process  and  is  itself  a Poisson  process,  the 
input  process  is  Poisson.  Thus  Burke's  result  contradicts  the  assumption. 

3.3  Feedback.  The  feedback  stream  seems  to  be  quite  difficult  to  work  with. 
From  the  previous  section  we  know  that  it  is  either  not  independent  of  the 
arrival  stream  or  not  a Poisson  stream.  We  conjecture  that  both  of  these 
conditions  prevail.  If  so  then  the  known  superposition  theorems  cannot  be 
used  to  study  feedbacks  as  part  of  the  arrival,  feedback,  input  processes. 
Treating  the  feedback  stream  as  a filtered  version  of  the  Markov  renewal 
output  stream  appears  to  be  quite  difficult.  The  only  result  for  this  feed- 
back stream  that  we  have  is  given  by  the  following  analysis. 

Consider  the  probability  that  a sequence  of  n service  times  takes  less 
than  t,  given  that  we  start  with  i customers,  F^(t).  Let  Hn(t)  be  the  distri- 
bution function  of  the  sum  of  n service  times.  Either  the  first  busy  period 
terminates  with  one  ot  these  customers,  or  it  does  not.  Thus 

F?  ( t ) = Y I1  1 e‘Xz  1 <lHm(Z)Hn-m(t-,) 

1 m=  i 0 m (n,'I)! 


+ Pr|n-th  customer  is  served  during  the  first  busy  period  and 
be f ore  time  t ] , 


for  n • i. 


F.  (l)  = Pr|n-th  customer  served  by  t ime  t ] 


Ot he rw i se , 
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be t f^(t>  be  the  probability  that  a feedback,  occurs  before  time  t,  given  the 
queue  length  just  after  a feedback  was  i. 

Then 


f.U)  = l pqn  1 /0  d!in(z)  -l  If 

n-1  n=i+l  m=i 


n-1  r . . .m-i 

c 1 -Az  (Az)  ,„m/  x„n-m 


'0  m 6 Or^ijr  dH  (Z)H  (t_z) 


00  t t“U  n — i 

V T f n i “Au  (Au)  n -A(z)  , . 

+ A J / q n e (hTTTi  dH  (u)  *e  f • (t-u-z) 

n=i  u=0  z=0  ini;.  i 


4.0  Conclusions . There  are  several  conjectures  that  one  can  pose  concern- 
ing Jackson  networks  based  on  the  results  of  this  paper.  First  with  respect 
to  queue  length,  busy  period  and  departure  processes  if  one  adopts  the  "out- 
siders" view  [3]  these  processes  appear  to  be  those  generated  by  an  M/G/l 
queue  without  feedback.  However,  if  one  adopts  the  "insiders"  view  the  queue 

length  process  does  not  appear  to  behave  as  seen  by  the  "outsider". 

Flow  processes  in  this  network  cannot  be  explained  by  appeal  to  super- 
position, departure  and  random  deletion  results  for  Poisson  processes.  The 
requisite  independence  assumptions  both  within  and  between  streams  of  events 
are  not  satisfied  here.  Thus  one  cannot  assume  that  these  queues  which  act 

"as  if"  they  were  M/M/1  queues  to  the  "outsider"  are  M/M/1  queues  to  the 

"insider".  In  particular,  this  hints  at  the  possibility  that  in  these  net- 
works, even  as  simple  as  Jackson  networks,  any  attempt  to  decompose  the  net- 
work into  independent  M/M/1  queues  is  doomed  to  failure.  This  decomposition 
must  account  for  the  internal  t lows  and  these  not  only  appear  to  be  non-Poisson, 
they  appear  to  he  non-renewal  and  are  dependent  on  each  other. 

We  conjecture,  based  on  current  papers  in  process,  that  if  pj*?^  -0  tor 
some  i and  n 0 , in  the  Jackson  Structure,  then  I low  along  any  path  that  returns 
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a customer  to  a node  that  he  has  previously  visited  is  not  only  not  Poisson 
it  is  not  renewal.  Thus,  if  Jackson  networks  have  loops,  direct  feedback  as 
in  this  paper  being  the  simplest  example,  they  cannot  be  decomposed  into  sub- 
networks of  simple  M/M/1  servers. 

in  particular,  these  results  probably  imply  that  a node-by-node  analysis 
of  waiting  times,  depending  as  they  do  on  the  "insiders"  view  is  not  valid  if 
one  simply  uses  M/M/1  results  at  each  server. 

That  these  queues  with  feedback  are  far  from  trivial  is  clear.  Considerably 
more  research  is  needed  to  thoroughly  understand  what  effect  feedback  has  on 
queueing  networks. 
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